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ABSTRACT 

This report includes a capsule description of changes 
in science achievement, as part of the National Assessment study of 
changes in science achievement for 9-*year-'olds, 13--year-*olds, and 
17-year-'olds attending schools. Concrete information is presented in 
the progress or decline of knowledge in science. It is reported that 
knowledge of fundamental scientific facts and principles has declined 
among American students. Data reported are based on an estimate of 
the percentage of individuals in a given age population who responded 
acceptably to a given question. To assess the growth or decline in 
attainment on a given question, the difference between performance in 
1969^70 and 1972--73 was obtained. National results by age level are 
reported. Also presented is how groups of individuals responded to 
certain exercises. The groups are characterized by age, sex, race, 
region of the country, level of parental education, and size and type 
of community. A brief section includes putting the data into 
perspective. (Author/EB) 
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FOREWORD 



The National Assessment of Educational Prog- 
ress (NAEP) is an information-gathering proj- 
ect which surveys the educational attainments 
of 9-year-olds, 13-year-olds, 17-year-olds and 
adults (ages 26-35) in 10 learning areas: art, 
career and occupational development, citizen- 
ship, literature, mathematics, music, reading, 
science, social studies and writing. At least 
one area is assessed every year, and all areas 
are periodically reassessed in order to measure 
educational progress. Lach assessment is the 
product of several years work by a great many 
educators, scholars and lay persons from all 
over the country. Initially, these people de- 
sign objectives for each area, proposing gen- 
eral goals which they feel Americans- should 
be achieving in the course of their education. 
These goals are reviewed by more people and 
then passed along to developers of tests, 
whose task it is to create measurement tools 
appropriate to the objectives. 

When the exercises prepared by the test 
developers have passed extensive reviews by 
subject-matter specialists and measurement 
experts, they are administered to probability 
samples of various populations. The people 
who comprise those samples are chosen in 
such a way that the results of their assessment 
can be generalized to an entire national 
population. That is, on the basis of the 
performance of about 2,500 9-year.olds on a 
given exercise, we can generalize about the 
probable performance of all 9-year-olds in the 
nation. Approximately 100,000 persons parti- 
cipate annually. 



After assessment data have been collected, 
scored and analyzed. National Assessment 
publishes reports to present the results as 
accurately as possible. Not all exercise results 
are released for publication. Because NAEP 
will administer some of the same exercises 
again in the future to determine whether the 
performance level of Americans has improved 
or declined, it is essential that they be kept 
secret in order to preserve the integrity of the 
study. If the unreleased exercises can be 
discussed without revealing their content, 
they are examined;'However, the discussion is 
much less detailed than it is for the released 
exeircises. 

The National Assessment of Educational Prog- 
ress also publishes a General Information 
Yearbook which describes all major aspects of- 
the assessment process. This volume defines 
the categories by which results are reported 
and elaborates on the scientific procedures 
utilized. The reader who desires more detailed 
information about how National Assessment 
defines its groups, priepares and scores its 
exercises, designs its sample and analyzes and 
reports its results should consult General 
Information Yearbook, Report 03/04'GIY 
which is available, as are all Assessment 
reports, through the Superintendent of Docu- 
ments, U.S. Government Printing Office, 
Washington, D.G. 20402. 
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PREFACE 



When the United States Office of Education 
was founded in 1867, one charge set before 
its commissioner was to determine the na- 
tion's progress in education. Only recently has 
that century-old charge been addressed in a 
systematic way. It is being done by the 
National Assessment of Educational Progress 
(NAEF). ' 

Each year since 1969 NAEP has gathered 
census-like information about levels of educa* 
tional achievement across the country and 
reported its findings to the nation. During the 
first five years of its endeavors, National 
Assessment has interviewed and tested more 
than 400,000 representative young Ameri- 
cans. Baseline data on the achievement levels 
of young Americans in eight learning areas- 



science, social studies, music, literature, read- 
ing, writing, mathematics and citizenship- 
have been collecSed and reported. 

This report, National Assessments of Science, 
1969 and 1973: A Capsule Description of 
Changes in Science Achievement, summarizes 
the National Assessment study of changes in 
science achievement for 9-year-olds, 13-year- 
olds and 17-year-olds attending schools. 
Having assessed achievements in science twice, 
NAEP can now report to the American public 
concrete information on the progress or 
decline of knowledge in science. This report is 
only a very brief summary of the information 
NAEP has gathered. Future reports will pro- 
vide more complete documentation and dis- 
cussion of these and other results. 
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INTRODUCTION 



Knowledge of fundamental scientific 
facts and principles has declined among 
American students. A comparison of the 
results for the 1969-70 national science 
assessment and the 1972—73 national 
science assessment indicates that 9-year- 
okis, 13-year-olds and 17-year-olds tend 
not to perform as well as they did three 
to four years ago. 



Although suspicions have been growing 
among scientists and nonscientists alike that 
public knowledge of and interest in science 
has declined in recent years, until now there 
has been no national data that could either 
substantiate or refute these suspicions. The 
initial national assessment of science took 
place in 1969—70. The second one was 
administered in 1972—73.' These represent 



'The assessment schedule varied for each age level. 
The actual administration dates were: 



9*year*olds 
13»year-olds 
17-yearK)lds 



Jan.-Feb. 1970 
Oct-Dec. 1969 
March—May 1969 



Jan.— Feb. i973 
Oct.— Dec. 1972 
March-r-May 1S73 



the first comprehensive assessment of the 
educational attainments of Americans in sci-. 
ence ever attempted and provide concrete 
information about changes in the levels of 
knowledge of American youth between 1969 
and 1973. 

In the first National Assessment (NAEP) 
study in 1969-70, 9-year-okis, 13-year-olds 
and 17-year-olds. attending school (age levels 
which mark the end of primary, intermediate 
and secondary education) were asked a vari- 
ety of questions designed to measure achieve- 
ment of four broad educational objectives in 
science. These objectives are (1) that Ameri- 
cans should know some fundamental facts 
and principles of science; (2) that they should 
possess some abilities and skills needed to 
engage in the process of science; ( 3) that they 
should understand the investigative nature of 
science; and (4) that they should have some 
attitudes about science and appreciate its role 
in the culture. Approximately one half of the 
questions asked in 1969—70 were repeated in 
1972—73. Using the same exercises again in a 
controlled manner, NAEP was able to meas- 
ure the increase or decline in attainment 
between the two science assessments. 
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NATIONAL RESULTS 



The data reported by the National Assessment 
of Educational Progress (NAEP) are based on 
an estimate of the percentage of individuals in 
a given age population who would respond 
acceptably to a given question. To assess the 
growth or decline in attainment on a given 
question, the difference between performance 
iri 1969-70 and 1972-73 was obtained. For 
example, 13-year-olds were asked the follow- 
ing question in the two assessments. 

Which of the following diseases is known to 
be transmitted by an insect? 

CZ^ Cancer 

CZ!^ Diabetes 

Malaria 

dD Measles 

CD Polio 

CD I don't know. 

In 1969, 84.6% of the 13-year-olds correctly 
identified malaria; however, only 77.0% of 
the 13-year-olds did in 1972. In 1972, 7.6% 
fewer 13-year-olds answered the question 
acceptably than did so in 1969. Put another 
way, the change from 1969 to 1972 was 
-7.6%. Given that there are approximately 3.6 
million 13-year-olds in the population, a 7.6% 
drop would mean that approximately 
270,000. fewer 13-year-olds would success- 
fully answer the question. 

At any given age level, the differences in the 
percentage of respondents who answered a 
question acceptably for the two assessments 
-v^YQ calculated and collected into a distribu- 



tion. The distribution represents the full range 
of differences f^^ ' ge level and is a 
comprehensive -so, ■ »cion of changes in 
performance, roi zhe sake of simplicity, 
however, this report will focus upon the 
average difference as an indicator of overall 
performance.' Since it is easy to understand, 
the average is a useful number to use when 
summarizing the change in performance for a 
given age level on a large number of questions. 



Results by Age Level 

Age 9 

Ninety-four questions asked of 9-year-olds in 
the first science assessnjent were asked of 
9-year-olds again in the second science assess- 
ment. In general, the performance of 9-year- 
olds tended to decline. On 31, or approxi- 
mately one third, of the questions more 
9-year-olds answered correctly in the second 
assessment. However, on two thirds (63) of 
the questions fewer 9-year-olds answered cor- 
rectly. The average performance (indicated by 
the arrow) declined 1.8%. This 1.8% drop 
suggests that an estimated 65,000 fewer 9- 
year-olds would answer a typical science 
question correctly in 1973 than would have 
done so in 1970. Exhibit 1 illustrates the 
complete distribution of changes at age 9, 
indicating that fewer 9-year-olds acceptably 
answered NAEP science questions in 1973 
than did so in 1970. 



In the following discussion of results, ttie lerm 
average performance is used to represent the arith- 
metic mean or what is commonly called the average. 
It is the Slim of percentages of success for each 
exercise divided by the number of exercises. 



1 
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EXHIBIT 1. Distribution of Changes in Performance 
in Science for 9-Y ear-Olds, 1970-73 



IS T 



-10 



-IS X 



3 
3 




3 
3 



On 31 questions, more 9-year-olds 
could answer correctly in 1972 
than in 1 970. 



On 63 questions, fewer 9-year-olds 
rould answer correctly in 1973 
'liian in 1970. 



Each box represents the change in performance on one science exercise. 



EXHIBIT 2. Distribution of Changes in Performance 
in Science for 13-Year Olds, 1969-72 



10 Y 



-5 



*10 X 




On 23 questions, more 13-year-olds 
could answer acceptably in 1972 
than in 1 969, 



On 46 questions, fewer 13-year-olds 
could answer acceptably in 1972 
than in 1969. 



Each box represents the change in performance on one science exercise. 
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Age 13 

Sixty-nine questions asked of 13-year-olds in 
the first science assessment were repeated in 
the second assessment. In general, the per- 
formance of 13-year-olds, like that of 9- 
year-blds, tended to decline. On 46 of the 69 
questions, 13-year-olds showed declines in 
performance; however, on 23 of the questions 
more 13-year-olds answered acceptably in the 



second assessment than did so in the first 
assessment. The average performance (indi- 
cated by the arrow) declined 1.9%. This 
suggests that an estimated 70,000 fewer 
13-year-olds would have responded accepta- 
bly to a typical science question in 1972 than 
would have in 1969. Exhibit 2 illustrates the 
complete distribution of changes for 13-year- 
olds. 



5-. 



-5.- 



-10-- 



-15i 



EXHIBIT 3. Distribution of Changes in Performance in Science 
for 17-Year-OIds Enrolled in School, 1969-73 



I 



On 16 questions, more 17-year-oIds 
could answer acceptably in 1973 
than in 1969. 




3 

33 

3 



On 5! questions, fewer l7-year-oIds 
could answer correctly in 1973 
than in 1969. 



Each box represents the change in performance on one science exercise. 



Age 17 

Sixty-seven questions, asked of 17-year-olds 
enrolled in school in 1969, were repeated in 
the second science assessment. In general, 
fewer 17-year-olds answered questions cor- 
rectly in 1973 than did so in 1969. On 51 
questions; 17-year-olds showed declines in 
performance; however, on 16 questions more 
17-year-olds answered acceptably in the sec- 
ond assessment than had done so in the first 
assessment. The average performance (indi- 



cated by the arrow) declined 2.3%, suggesting 
that an estimated 80,000 fewer 17 -year-olds 
would have responded acceptably to a typical 
science question in 1973 than would have in 
1969. Exhibit 3 shows the complete distribu- 
tion of changes for 17-year-olds, illustrating 
the slight decline in performance between the 
first and second assessments. The impact of 
this decline is lessened when one considers 
that it reflects change over a four-year period 
compared to three years at ages 9 and 13. 
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NATIONAL ASSESSMENT REPORTING VARIABLES AND GROUP RESULTS 



Reporting Variables 

The National Assessment of Educational Prog- 
ress (NAEP), unlike most testing programs, 
does not report scores for individuals. ' 
Rather, it reports how defined groups of 
individuals respond to certain exercises. The 
groups are characterized by age, sex, race, 
region of the country, level of parental 
education and size and type of community 
{STOC). 



More detailed information on the methodology 
employed by NAEP can be found in the General 
Information Yearbook, Report 05/04-G/K,(Washing- 
ton, D.C.: Government Printing Office, 1974). Spe- 
cific chapters on sampling, objectives and exercise 
development, administration, data processing and 
analysis procedures can be found in this volume. 



The groups discussed in this capsule descrip- 
tion are defined as follows.^ 



Region 

The students have been divided into four 
groups, each representing a region of the 
country— Southeast, W'^jt, Central and North- 
east—as shown in Exhibit 4. 



Some group results are not discussed in this capsule 
description. Data are also collected for respondents 
who are neither black nor white within the variable 
color; for the highest level of parental education 
attained by either of a respondent's parents from no 
high school through post high school; and for 
medium cities, small places and urban fringe within 
the variable size and type of community. These 
groups will be discussed in later reports. 



EXHIBIT 4. National Assessment Geographic Regions 
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Sex 

Results are presented separately for males and 
for females. 



Color 

Results are presented for blacks and whites. 



Size and Type of Community (STOC) 

The groups within this variable are defined by 
the size of the community in which a stu- 
dent's school is located and an occupational 
profile of the area the school serves. 

Low metro. People (about 10% at each age 
level) in this group attend schools serving 
areas in which a high propoition of the 
r-'iidents are on welfare or not regularly 
employed; these schools are in cities with 
populations greater than 150,000, 

Extreme rural. Students (about 10% at each 
age level) in this group attend schools in a 
community where most residents arc farmers 
or farm workers, and the population is less 
than 3,500. 

High metro. Individuals (about 10% at each 
age level) in this group attend schools within 
the city limits or residential area served by a 
city with a population greater than 150,000; 
many residents of the area served b^ the 
school are professional or managerial per- 
sonnel. 

Mam big city. These are students (about 11% 
at each age level) attending schools in a big 
city (population greater than 200,000) who 
are not included in either the low metro or 
high metro groups. 



Group Results 

Each group's percentage of success is com- 
pared to the percentage of success obtained 
for the national sample. The difference be- 



tween these two percentages indicates how 
well a group is performing in relation to the 
nation as a whole. For example, the following 
exercise was given to 13-year-olds in 1972. 




Stopper 

Test Tube 
Water 

Candle 



Water is heated as shown in the diagram 
above. If the stopper pops out, which of the 
following is most important in accounting for 

this? 

The stopper gets hot and expands. 

'0/^ Some of the water is changed to 
steam. 

C3 The air in the test tube absorbs 
heat. 

The glass test tube gets very hot and 
starts to melt. 

The glass test tube expands more 
than the stopper. 

CZ^ I don't know. 

In the high metro group 54.8% of the 
13-year-olds answered this exercise correctly 
compared to 52.2% of all the 13-year-olds, 
The difference between these two percentages 
(54-8% -52.2%) is 2.6%. Since the national 
percentage of success is always subtracted 
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from the group percentage, a positive differ- 
ence means that the group is performing at a 
level better than the national level of perform- 
ance; a negative difference means that the 
group is not performing as well as the nation. 
In this case, +2.6% means a higher proportion 
of high metro 13-year-olds knew the answer 
to this question than 13-year-oIds nationally. 

Changes in group performance are measured 
by changes in the percentage of success for 
that group and by changes in the group's 
position relative to the nation. By observing 
these two changes we can determine, first, 
whether a larger or smaller proportion of 
respondents answered a question correctly in 
1972—73 than in 1969-70 and, second, 
whether or not there was a change between 
the assessments in the group's standing rela- 
tive to the nation as a whole. Both types of 
information contribute to an understanding 
of how the performance of a given group has 
changed. The following example illustrates 
the types of change information group results 
provide. 

This question was asked of 9-year-olds in 
1970 and again in 1973. 

Putting sand and salt together makes 

a chemicai 

a compound, 

an element, 

a mixture, 

CZ) a solution, 

I don't know. 

In the first science assessment 61.5% of the 
9-year-olds answered this question acceptably. 
By comparison only 55.1% of the South- 
eastern 9-year-olds did so. Subtracting the 
national percentage (61.5) from the South- 
eastern percentage (55.1) leaves a group dif- 
ference of -6.4. In other words, 6.4% fewer 
Southeastern 9-year-olds than 9-year-olds 



nationally knew that putting sand and salt 
together makes a mixture. 

When asked the identical question in 1973, 
61.7% of the 9-year-olds nationally answered 
the question correctly compared to 59.2% of 
the Southeastern group. In this instaiice, the 
difference between the Southeast and the 
nation was -2.5%. That is, 2.5% fewer South- 
eastern 9-year-olds than 9-year-olds nationally 
gave the correct answer. Exhibit 5 presents 
the relative position of Southeastern 9-year- 
olds and the nation on this question in both 
assessment years. The national performance 
level in 1970 (61.5%) serves as the point of 
reference on the graph. The Southeast per- 
formance in 1970 is plotted at 55,1%. The 
national level of performance in 1973, 6U%, 



EXHIBIT 5. An Example of Chunge in Southeast 
Performance on One Exercise 

i 
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is plotted above the baseline performance 
established in 1970. The Southeast 
performance in 1973, 59.2%, is plotted 2.5 
points below the national level in 1973. 

Although Southeastern performance on this 
exercise was still below the national level in 
1973, there was considerable improvement 
relative to Southeastern achievement in 1970 
The gap between national performance and 
the performance of Southeastern 9-year-olds 
had appreciably narrowed between the 
assessments. 

While changes in group performance on indivi- 
dual questions are informative and interesting, 
a comparison of the average performance for 
a given group in the first assessment with the 
average performance of the same group in the 
second assessment is a more useful indicator 
of the general performance trend of that 
group. Exhibits 6 through 9 display the 
average performance levels of National Assess- 



ment groups in both assessment years. The 
relative position of the groups in 1969—70 
and the average national performance level are 
shown on the left side of the graph. Average 
group performances are plotted above and 
below the national level. The average national 
level of performance and average group per- 
formance in 1972—73 are shown on the 
right-hand side. The slope of the line depicts 
the direction and rate of change in perform- 
ance between the first and second science 
assessments. 

Exhibits 6, 7, 8 and 9 indicate that most of 
the groups performed less well in the second 
assessment than they had in 1969. Only a few 
groups improved. For example, the extreme 
rural and Southeastern groups did improve 
relative to the nation between 1969 and 
1973. If the trends they exhibited should 
continue, these groups could reach national 
levels of performance in less than a 
decade. 
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EXHIBIT 6. Average Regional Changes in Performance 
at Ages 9, 13 and 17 
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While Northenstern, Central and Western performance 
levels all declined, Southeastern performance re- 
mained about the same or showed a slight improve- 
ment. Considering that the nation as n whole 
declined, the Southeastern results are more impres- 
sive. Western performance declined most noticeably 
except at age 9. 

KEY: 

NE - Northeast 
C - Central 
W -West 
SE - Southeast 
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EXHIBIT 7. Average Changes in Performance for Males and Females 
at Ages 9, 13 and 17 , 




The percentages of males and females that answered a 
typical science question correctly declined at all three 
age levels. Furthermore, the gap between males and 
females remained constant. The performance of 
9-year-old boys is, on the whole, 2 to 3% above that 
of girls. The average performance of 13-year-old boys 
is still 4% above that of girls. At age 17, average male 
performance is 6% above that of females. 
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KEY: 

M Male 
F - Female 
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EXHIBIT 8. Average Changes in Performance for Blacks and Wliites 
at Ages 9, 13 and 17 
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The gap between the performance of black and white 
9-year-oIds remained about the same between 1970 
and 1973. At age 13 this gap increased slightly. Black 
13-year-olds declined somewhat more than the nation 
as a whole. The gap between the performance levels 
of white and black 17-year-olds remained about the 
same between 1969 and 1973. 

KEY: 

W - White 
B - Black 
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EXHIBIT 9. Average Changes in Performance for Selected Size 
and Type of Community (STOC) Groups at Ages 9. 13 and 17 
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The percentage of rural students that could answer a 
typical science question correctly increased notice- 
ably at all three ages. Low metro areas are well below 
the nation and are not improving. At age 17, main big 
city students showed the greatest declines, dropping 
from just above the national level to well below. High 
metro students at all three age levels continued to 
perform above the national level, although they-are 
declining at about the same rate as the nation. 



— ^ 




KEY: 



HM — High metro 
MBC— Main big city 
LM — Low metro 
ER - Extreme rural 
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PUTTING THE DATA INTO PERSPECTIVE 



The average decline in science achievement at 
all three ages between 1969-70 and 1972—73 
was about 2 percentage points. Identical 
science exercises given at more than one age 
level in the same assessment generally show an 
average gain of 4% per year of age in the 
proportion of respondents able to answer 
acceptably. Thus, this average decline of 2 
percentage points in the proportion of stu- 
dents answering science questions would 
appear to correspond to the loss of a half year 
of learning experience. 

A number of factors might account for 
declines in science achievement between 
1969-70 and 1972-73. The decline in the 
number of young Americans demonstrating 
knowledge in science may simply reflect the 
fact that fewer students are electing to take 
science courses. It is possible that achieve- 
ment levels may be rising among those stu- 
dents enrolled in science curricula; the 
National Assessment of Educational Progress 
(NAEP) assessed all students at these age 
levels, not just those interested in science. 
Teachers may well be doing a better job than 
ever with a select group of students who will 
form the nucleus of the next generation's 
scientific community. 

Perhaps the results of the science assessment 
are satisfactory and as expected. Quite possi- 
bly less attention is being paid to science in 
the schools these days; the declines between 
1969 and 1973 may only suggest that unusual 
emphasis was given to science education in 
the wake of "Sputnik," and the new results 
reflect a return to more normal achievement 
levels. On the other hand, our society is 
becoming more technological and complex, 
and this may be a poor time for such a 
decline. Average citizens must have some 
basic knowledge about science to remain 



informed about critical social and environ- 
mental issues upon which they are expected 
to make rational decisions. Can the average 
citizen know too much science, given the 
complexity of the world that confronts us? 
Should the general public be encouraged to 
appreciate science for its own virtues? Are we 
training enough good scientists to meet the 
growing needs of our technological society? 
Should scientists and science educators 
attempt to make science more relevant to the 
social and political concerns of both majority 
and minority Americans? The public at large 
should join the scientific and educational 
communities in discussing these issues. 

Education is the largest single enterprise in 
the United States today. Three out of every 
10 Americans are directly involved in the 
educational process, and expenditures have 
more than doubled in the last decade, with an 
estimated $54 billion being spent for elemen- 
tary and secondary education in 1971 alone.' 
A great deal of effort has gone into improving 
the educational system. Yet, at least in 
science, there was a general decline in the 
knowledge levels of American youth between 
1969-70 and 1972-73. Furthermore, the 
gap between national and group performance 
in science has not been narrowed for females, 
black Americans or students from low metro 
schools. The facts highlighted in this report 
should stimulate discussions about national 
interest in science, school responsibility for 
science education and the long-term implica- 
tions of a downward trend in. science 
achievement. 



*W. Vance Grant, "Education's New Scorecard,** 
Selected Statistical Notes on American Education, 
DHEW Publication No. (OE) 73-111703 (Washington, 
D.C.: Government Printing Office, February 1973), 
pp. 3-8. 
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Official National Assessment Reports 
(Continued From Inside Front Cover) 



Literature 

02-L-OI Understanding Ininginntive Language, March 1973 $2.65 

02-L-02 Responding to Literature, A pril 1 973 2.85 

02-L-03 Recognizing Literary Works and Characters, April 1973 2.60 

02-L-04 A Survey of Reading Habits, May 1973 2.85 

02-L-20 Released Hxercises, April 1973 3.45 

02- L-OO Summary Data, June 1973 1.30 

1971— 72 Assessment 

03/04-GIY General Information Yearbook-A description of National Assessment's 

methodology, with special attention given to Music, Social Studies, Science 

and Mathematics, December 1974 1,20 
Social Studies _ _ 

03- SS-Ol Political Knowledgeand Attitudes, December 1973 1,05 
03-SS-02 Contemporary Social Issues, July 1974 ,65 
03-SS-OO The First Social Studies Assessment: An Overview, June 1974 .90 

Music 

03-MU-OI The First National Assessment of Musical Performance, February 1974 ,55 

03-MU-02 A Perspective on the First Music Assessment, April 1974 ,45 

03-MU-03 An Assessment of Attitudes Toward Music, September 1974 .85 

03- MU-OO The First Music Assessment: An Overview, August 1974 .60 

1972— 73 Assessment ' 
Mathematics 

04- MA-OI Math Fundamentals: Selected Results From the First National 

Assessment of Mathematics, January 1975 - 1,10 

Science 

04-S-OO National Assessments of Science, 1969 and 1973: A Capsule Description 

of Changes in Science Achievement, February 1975 .75 
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